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[57] 



ABSTRACT 



A block sequence compiler for compiling a sequence of 
audio and/or video blocks (e.g., audio tracks, MIDI, video 
clips, animation, etc.) suitable for producing one or more 
audio and/or video output sequences (i.e., audio, video, or 
multimedia) each having a duration corresponding to user- 
prescribed criteria. In a preferred embodiment, a user 
chooses an audio and/or video source segment from a 
predefined library and prescribes the duration of an audio 
and/or video sequence. Prior to depositing each audio and/or 
video segment in the library, the segment is partitioned into 
audio and/or video blocks that are identified in a correspond- 
ing characteristic data table with characteristics including 
(1) duration, (2) suitability for being used as a beginning or 
ending of an audio and/or video sequence, and (3) compat- 
ibility with each block. Using this characteristic table and 
the user-prescribed criteria, i.e., duration, the block 
sequence compiler generates a plurality of audio and/or 
video sequences satisfying the user-prescribed criteria which 
can be reviewed, e.g., played, and/or saved for future use. 

20 Claims, 12 Drawing Sheets 
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1 

SYSTEM FOR GENERATING PRESCRIBED 
DURATION AUDIO AND/OR VIDEO 
SEQUENCES 

This application is a continuation in part of application 
Ser. No. 08/532,527, filed Sep. 22, 1995, now U.S. Pat. No. 
5,693,902. 

BACKGROUND OF THE INVENTION 

The present invention relates generally to hardware/ 
software systems for generating audio and/or video 
sequences of prescribed duration and more particularly to 
such systems suitable for generating and correlating such 
sequences for producing multimedia presentations. 

Exemplary multimedia presentations are formed from 
video source material, e.g., a video segment such as a film 
clip, and audio source material, e.g., an audio segment such 
as a sound track. Typically, the video source segment must 
be edited many times before an aesthetically satisfactory and 
proper duration video output sequence is achieved. The 
audio source segment must similarly be edited to form an 
audio output sequence that matches the duration of the 
edited video output sequence. 

SUMMARY OF THE INVENTION 

The present invention is directed toward a system for 
compiling a sequence of data blocks for producing an audio 
and/or video output sequence having a duration correspond- 
ing to user-prescribed criteria. 

In a preferred embodiment, a user (via a keyboard and/or 
mouse and a display monitor) chooses an audio and/or video 
source segment from a data storage library storing data 
representing original sound tracks, MIDI data, film clips, 
animation clips, etc., and prescribes the desired duration of 
an audio and/or video output sequence. Each segment in the 
data storage library is divided into data blocks whose 
characteristics are identified in a stored characteristic data 
table. Exemplary characteristics include (1) duration, (2) 
suitability for being used as a beginning or ending of an 
output sequence, and (3) interblock compatibility. Using this 
stored characteristic table and user-prescribed criteria (e.g., 
a duration specified via the keyboard), a block sequence 
compiler (preferably a software program executed by a 
computer) generates a plurality of audio and/or video block 
sequences satisfying these criteria which can be reviewed 
(e.g., played via an audio and/or video output device or 
displayed on a monitor) and/or saved for future use. 

In an exemplary use, the block sequence compiler com- 
piles a first output sequence suitable for presentation on a 
first channel. Optionally, the block sequence compiler can 
also compile one or more additional output sequences com- 
patible with the first output sequence (according to addi- 
tional stored characteristic table parameters) suitable for 
presentation on additional output channels to create a mul- 
timedia presentation. 

In a further aspect of a preferred embodiment, the block 
sequence compiler is responsive a user-prescribed mood 
parameter stored in the characteristic table. 

In a still further aspect of a preferred embodiment, the 
stored characteristic table additionally contains a parameter 
that identifies blocks that are fadeable. When a fadeable 
block is selected as an end block, the block sequence 
compiler can truncate the fadeable end block to generate an 
output sequence of the prescribed length which might oth- 
erwise not be achievable. 
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In a further aspect of a preferred embodiment, the block 
sequence compiler is responsive to a user-prescribed inten- 
sity parameter stored in the stored characteristic table. 
In a still further aspect of a preferred embodiment, each 

5 block is identified in the stored characteristic table as having 
a hit point that defines the location (when present) of an 
intensity burst. The block sequence compiler can use the hit 
point parameter to place an intensity burst at a user- 
prescribed location in the compiled output sequence. 

10 In another aspect of a preferred embodiment, the system 
enables a user to generate a sequence (or subsequence) of 
data blocks which can be executed one or more times, e.g., 
looping, to form an output sequence of extended duration. In 
a first variation, the compiler selects the last block of a 

15 sequence which is compatible with the first block to generate 
a repeatable sequence. Accordingly, the repeatable sequence 
can be repetitively executed from the first to the last block 
and then looped back to the first block. In a second variation, 
blocks in the repeatable sequence are selected which have a 

20 reversible attribute, i.e., blocks that can be played either in 
a forward or a reverse direction. Accordingly, the repeatable 
sequence can be repetitively played in a forward direction 
from the first to the last block and then in a reverse direction 
from the last block to the first block, again resulting in a 

25 sequence having an extended duration. 

Other features and advantages of the present invention 
should become apparent from the following description of 
the presently-preferred embodiments, taken in conjunction 

3o with the accompanying drawings, which illustrate, by way 
of example, the principles of the present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 comprises a functional block diagram of a block 
35 sequence compiler in accordance with the present invention 
for generating audio and/or video sequences having user- 
prescribed durations; 

FIG. 2 is a simplified diagram of a characteristic table 
showing the parameters associated with each audio and/or 
40 video block; 

FIG. 3A is a simplified flow chart of the operation of the 
system of FIG. 1; 

FIG. 3B is a simplified flow chart depicting the process 
implemented by the block sequence compiler; 
45 FIG. 4 is an exemplary characteristic table for a fifty 
second source audio and/or video segment; 

FIG. 5 shows the iterations performed by the block 
sequence compiler according to the flow chart of FIG. 3B on 
the characteristic table data of FIG. 4; 

50 

FIG. 6 is a simplified flow chart depicting the process 
implemented by the block sequence compiler to compile a 
repeatable audio and/or video sequence generated by loop- 
ing the last block to the first block of the compiled sequence; 

55 FIG. 7 shows the iterations performed by the block 
sequence compiler according to the flow chart of FIG. 6 on 
the characteristic table data of FIG. 8; 

FIG. 8 is an exemplary characteristic table for a fifty 
second source audio and/or video segment used in conjunc- 

60 tion with the flow chart of FIG. 6; 

FIG. 9 is a simplified flow chart depicting the process 
implemented by the block sequence compiler by selecting 
blocks having a reversible attribute to compile a repeatable 
audio and/or video sequence; 

65 FIG. 10 is an exemplary characteristic table for a fifty 
second source audio and/or video segment used in conjunc- 
tion with the flow chart of FIG. 9; 
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FIG. 11 is block diagram an exemplary system for gen- physically located outside of the library, e.g., on a CD-ROM 

crating multiple compatible audio and/or video channels, or DVD, and referenced, e.g., by pointers, by the charac- 

i.e., multimedia, according to user-prescribed criteria; and teristic table 30. FIG. 2 shows an exemplary structure for the 

FIG. 12 is a simplified diagram showing multiple audio characteristic table 30. Each entry 26 in the characteristic 

and/or video channels generated by the exemplary system of 5 table 30 contains a definition/pointer 32 which includes 

Fig ft identifying information for the library entry, e.g., a title and 

the physical location of the audio and/or video source 

DESCRIPTION OF THE PREFERRED segment 28, e.g., a CD-ROM file. Each characteristic table 

EMBODIMENTS entrv ^ is farther divided into a plurality of entries that 

10 define blocks, i.e., audio and/or video data blocks, and 

With reference now to the drawings, and particularly to associated characteristics for the audio and/or video from the 

FIG. 1, there is shown a block diagram of a preferred audio and/or video source segment 28. 

embodiment of an audio and/or video sequence generator 10 ^ a simplified example, an audio and/or video source 

of the present invention for compiling a sequence of data segment 28 is divided into five blocks: A, B, C, D, E, F 

blocks suitable for producing an audio and/or video output 15 where me seqU ence ABCDEF corresponds to the audio 

sequence having a duration corresponding to user-prescribed and/or video source segm ent 28. Although, other combina- 

criteria. In a preferred embodiment, the sequence generator ti ons of 51ocU e ^ fedcba, can also create audio and/or 

10 is comprised of a computer-executed software program, video sequences, not all block sequences will create aes- 

generally initially present on a floppy disk, and which thetically reasonable audio and/or video sequences. Thus, 

preferably finally resides on the hard disk of a personal 20 information is preferably derived to determine interblock 

computer (PC) 12, e.g., a Macintosh or IBM compatible PC, compatibility, i.e., the ability of a block to sequentially 

controlled by a processor 13. As such the following follow (or alternatively sequentially precede) each other 

discussion, relates to these preferred PC environments. block according to aesthetic, e.g., musical, criteria. For 

However, different computer platforms or hardware-only example, while block C may reasonably follow block B, it 

implementations are also considered within the scope of the 25 may not ^ aesthetically reasonable for it to follow block A. 

invention. Additionally, while some blocks, e.g.. A, are suitable accord- 

The sequence generator 10 is primarily comprised of (1) ing to aesthetic criteria to reasonably start an audio and/or 
a data storage library 14 (preferably comprised of data video sequence, other blocks are not Similarly, only certain 
blocks corresponding to or pointing to audio tracks, MIDI blocks, e.g., F, are suitable according to aesthetic criteria to 
data, video clips, animation, or any other data representative 30 reasonably end an audio and/or video sequence. Lastly, not 
of sound or visual information) and (2) a block sequence all audio and/or video source segments 28 can reasonably be 
compiler 16. In operation, a user interface 17, e.g., a divided into fixed length blocks. In fact, using reasonable 
keyboard/mouse 18, enables a user to select a source seg- aesthetic criteria, blocks will generally be differently sized, 
ment 28 from the data storage library 14 and prescribe a Consequently, audio and/or video sequences of many dif- 
duration. This information is communicated to the block 35 ferent durations can be achieved by combining different 
sequence compiler 16 which, under control of a software combinations of these differently-sized blocks. However, as 
program executed by the processor 13 in the PC 12, fetches previously described, the available combinations are limited 
blocks of audio and/or video source information (preferably by the compatibility between potentially adjacent blocks as 
digital data) from the data storage library 14 and, according well as their suitability to begin or end an audio and/or video 
to compilation criteria described further below, compiles a 40 sequence. Corresponding to these criteria, data in the char- 
list of potential audio and/or video sequences that are acteristic table 30 contains parameters for each audio and/or 
preferably temporarily stored within a potential block video block pertaining to a (1) duration 34, (2) type attribute 
sequence list depository 19. In the case of audio (e.g., an (e.g., beginning/ending) 36, and (3) an interblock compat- 
audio track or MIDI data) output sequence, the user can ibility list 38 (e.g., a list of which blocks can aesthetically 
select to play the audio sequence via a sound card/speaker 45 follow and/or precede the current block). Additionally, infor- 

20, review a list of potential block sequences via a monitor mation (not shown) identifying the physical location of each 

21, or store selected sequences for future use, e.g., on a hard audio and/or video block in the audio and/or video source 
disk 22. Alternatively, in the case of a video sequence (e.g., segment 28 is preferably retained in the characteristic table 
video clip or animation data), the user can select to play the 30. Whild data in the characteristic table 30 can be manually 
video sequence (preferably via a video card 24 and monitor 50 generated, automated procedures are also possible. 

21), review a list of potential block sequences via the FIG. 3B shows a simplified flow chart exemplary of the 

monitor 21, or store selected sequences for future use, e.g., iterative process implemented by the block sequence com- 

on the hard disk 22. In either case, the block sequence piier 16 after being provided the user-prescribed data (as 

compiler 16 can preferably be directed to only compile a shown in FIG. 3A). As previously described, after the user 

single audio and/or video output sequence and then wait 55 has determined a selection 40 from the data storage library 

until prompted by the user to generate a next audio and/or 14 and a duration 42, the block sequence compiler 16 

video output sequence. operates on the data in the characteristic table 30 according 

The data storage library 14 preferably contains library to the flow chart of FIG. 3B. Accordingly, a list of potential 

entries 26 pertaining to a plurality of audio and/or video output sequences is compiled that conform to the charac- 

source segments. Each library entry 26 is comprised of (1) 60 teristic table 30 and these sequences are stored in the 

an audio and/or video source segment 28 and (2) a stored potential block sequence list 19. In order to conform to the 

characteristic data table 30 which describes the partitioning characteristic table, each block in an output sequence must 

of the audio and/or video source segment 28 into multiple be compatible with each adjacent block according to its 

data blocks and the characteristics of each block Although, interblock compatibility characteristic 38, i.e., each block 

the source segment 28 is shown as being located within the 65 must be compatible with blocks which directly precede and 

data storage library 14, one of ordinary skill in the art will follow in an output sequence. Additionally, it is preferable 

recognize that the source segment 28 can alternatively be that each sequence begin with a block having a beginning 
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characteristic 38 set and end with a block having an ending 
characteristic 36 set 

FIG. 4 shows an exemplary characteristic table for a fifty 
second audio and/or video source segment 28. In this 
example, the source segment is partitioned into ten blocks, 
each being five seconds long. (While fixed length blocks 
exist in this example, this is generally not the case). In this 
example, blocks A and C have been marked as potential 
beginnings and blocks E and J have been marked as potential 
endings. In the example shown in FIG. 5. the user has 
selected a duration 42 of thirty-five seconds for this source 
segment 28. Accordingly, FIG. 5 shows the iterations per- 
formed by the block sequence compiler 16 on the charac- 
teristic table 30 of FIG. 4 according to the flow chart of FIG. 
3B. FIG. 5 shows that the original audio and/or video 
sequence has now been rearranged into three potential 
sequences (ABCDEFGJ, ABCDEFHE, CDEFGHD) that 
each (1) have the prescribed duration, (2) begin with a 
beginning block, and (3) end with an ending block. 

In an exemplary audio environment, the generator 10 
allows users to quickly and easily create movie or record 
quality music soundtracks for any application or document 
that can import sound The sequence generator 10 is able to 
accomplish this by processing an audio source segment, e.g., 
music, in response to user inputs. The user selects a musical 
style and sub-style from a list, then specifies the length 
(preferably in minutes, seconds and tenths of seconds). A 
musical source segment is selected from the library that 
meets the user's needs and a custom version of that music is 
created that is exactly (within user-prescribed criteria) the 
specified length. If the user doesn't like the selected music, 
the user can hear a different version of the same music or a 
different piece music — all of the versions presented will fit 
the user's specifications. 

By using music and its corresponding characteristic table 
30 and input from the user, the block sequence compiler 16 
can customize the following aspects of the music: 
The length of the music can be customized in tenths of a 

second increments from seconds to hours. 
Different versions of the same piece of music (sometimes 

hundreds of thousands of options) can be generated. 
In an alternative embodiment, the block sequence com- 
piler 16 can customize the intensity of the music. The 
user can define a desired intensity curve 44. This will 45 
allow the user to have the program make a piece of 
music that begins softly (perhaps while an announcer 
speaks) and builds to a climax (perhaps when the 
narration has ended). In this embodiment, an intensity 
parameter 46 is added to the characteristic table 30 for 
each block and the block sequence compiler 16 selects 
blocks that most closely correspond to the prescribed 
intensity curve 44. 
In a next alternative embodiment, the user can specify a 
mood selection 48 to modify the mood of the music 55 
without changing any other characteristics. In this 
embodiment, a mood parameter 50 is added to charac- 
teristic table 30. Additionally, multiple renditions of the 
audio source segment 28 are prerecorded correspond- 
ing to different moods. TTie block sequence compiler 16 60 
will then select renditions that correspond to the pre- 
scribed mood parameter 50. 
In another alternative embodiment, a user can specify a 
first duration of background music followed by a 
second duration of introductory music. The compiler 65 
16 will be able to locate two different pieces of music 
and make a smooth, musical, transition between them. 



In an additional alternative embodiment, blocks can be 
identified with a fadeable parameter 52 in the charac- 
teristic table 30. When a block is fadeable, its duration 
can be truncated to become a satisfactory end block, 
even if its duration would normally be too long. The 
compiler 16 can then truncate the fadeable block to 
achieve the user-prescribed duration. Additionally, the 
intensity of the end of the fadeable block will fade at a 
prescribed rate to reduce the effects of the truncation. 
In still another embodiment, each block can be identified 
in the characteristic table 30 as having a hit point 
parameter 54 that defines the location (when present) of 
an intensity burst When prescribed by the user, the 
block sequence compiler 16 can use the hit point 
parameter 54 to place an intensity burst at a user- 
prescribed location (e.g., defined by intensity curve 44) 
in the generated audio output sequence. 
Similar aspects of a corresponding video (e.g., video clip 
or animation) sequence can also be customized by the 
compiler 16 according to data within the characteristic table 
30. For example, if a static parameter 55 is placed within the 
characteristic table 30, this parameter can be used to identify 
blocks, preferably additionally having an ending type 36, 
that can be extended to a desired duration and thus can be 
used to simplify matching the user-prescribed duration 42. 
Accordingly, especially in a video environment, the last 
block can end with a still picture (a "freeze frame") that can 
be maintained as long as required to produce a sequence 
having the prescribed duration 42. 

The following defines the data structure for each block of 
the characteristic table in this exemplary audio embodiment: 
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40 



50 



filelnfo a pointer to which audio source segment this 

block is associated with 
blockS tart the sample number within the audio source 

segment at which this block begins 
blockLength the number of samples that this block contains. 

Hie end sample number is derived by adding 
blockStart and blockLength 
blockName the name to display on this block (no longer 

than 15 characters 
blockDesc the long text description of this block (up to 

63 characters) 

compatibility an array of bits specifying this block's 

compatibility with all other blocks in this file 

(described below) 
usageFlags bit flags indicating properties of this block 

(described below) 
nextBlock the block number of the best block to following 

this block 

quickEnd the block number of the best next block to end 

the music quickly 
blockSection a section number of this block assigned for use 

in grouping sub-blocks into grouped blocks for 

display 

blockPriority a priority number of this block assigned for use 
in displaying blocks at different detail levels 

blockiype a set of bits specifying if this block should be 

displayed, if the block is in -use, and other 
status flags. USER_BLOCK_TYPE, 
INVISIBLE_BLOCK_TYPE, 
AVAIL ABLE_BLOCK_TYPE 

selected a True/False flag indicating if the block is 

currently selected 

intensity each block is assigned an intensity index in 

relation to the other blocks in the file. The 
higher the intensity number, the more intense 
the audio in the block is in relation to the 
other blocks. 

hitPoint the sample number, if any, of a musical "Hit" 

within the block. (0 for no significant hit) 
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mcodlndex a number grouping this blocks mood with other 

blocks mood All blocks with the same moodlndex 
will have the same mood. 

next a pointer to the next block 5 



Compatibility 

Each block has an array of unsigned longs which are used 
as an array of bits. Each bit corresponds to a block from the 
data storage library 14, e.g., bit 15 should be set if the block 
is compatible with block 15. Compatible blocks are blocks 
which sound musically correct when they are played one 
after the other. For example. Block A should be flagged as 
compatible with Block B when it sounds musically correct 
to listen to Block A followed by Block B. If Block B was the 
24th block from the library source segment, then bit 24 of 
Block A' s compatibility array should be set. 



USAGEFLAGS 

DEAD_END__FLAG Set if this block will lead you directly 

toward an ending. Set this bit if this 
block is a bad choice to build a long 
cue 

(1L«0) 

NEXT_CONTIGUOUS_FLAG Set this bit if the next block doesn't 
need a crossfade to make a good 
sounding transition 
(1L«1) 

FADEABLE_BLOCK Set this bit to signal that this block 

can be effectively faded (in volume) 
to any length. 
(1L«2) 

BEGIMNG_BLOCK Set this bit if the block is a good 

choice (sounds musically correct) to 
begin a selection 
(1L«30) // 0x40000000 

ENDING_BLOCK Set mis bit if the block is a good 

choice to end a selection 
(1L«31) 7/0x80000000 



While some of the above functions (further defined in the 
data structure below) can be applied to existing music 
(through a process of specifying block characteristics), some 
are dependent on a custom music library in which music is 
composed and performed in a specific format. 



struct BlockS truct { 



SoundFilelnfoPtr 


filelnfo; // 


pointer to file 






struct for this block 


unsigned long 


blocks tart// 


sample number 


unsigned long 


blockLength;// 


number of samples 


Strl5 


blockName; 




Str63 


blockDesc; 




unsigned long 


compatibility[COMPAT_SrZE]; 


unsigned long 


usageFlags; 




short 


nextBlock; 




short 


quickEnd; 




unsigned char 


blocks ection; 




unsigned char 


blockPriority; 




BlockTypes 


blockiype; 




Boolean 


selected; 




BlockStructPtr 


next; 





1; 



HINTING/WARNING 

Using the characteristic table data associated with each 
data block, the user is assisted by visually displaying infor- 65 
mation about the blocks. Block attributes including 
beginnings, endings and compatibility are all displayed. 



Beginning- displayed by a stair-step pattern on 

the left edge of the block 

Ending- displayed by a stair-step pattern on 

the right edge of the block 

Compatibility- the rightmost end cap of a selection 

in the sequence window is colored and 
all of the compatible blocks in the 
block window will have their left end 
caps colored 

Warning- when two non-compatible blocks are 

next to each other, we display a red 
edge at their junctioa 



The process of specifying characteristics of music and 
sound is both musical and technical. This process is used to 
provide as much information as possible about each piece of 
music or sound so that the compiler 16 can make informed, 
musical decisions, when it manipulates the music according 
to requests from users. This process includes the following: 

1. Block Start and End: The beginning and ending of each 
discrete music section (block) is determined. This nec- 
essarily detenniries the length of each block. Listen to 
the piece of music and divide it into segments based on 
musical phrases and musical uses called blocks. On 
average, there are fifteen blocks per minute of music. 

2. Block Name: Code each block with a name and 
description. 

3. Beginning Blocks: For each block a determination is 
made as to whether it would make a good way to start 
a musical section or phrase. 

4. Ending Blocks: Same concept as that described for 
Beginning Blocks. 

5. Block Compatibility: Each block is tested for its 
specific compatibility to each and every other block 
which comprise the source audio segment 

6. Intensity: Code each block's musical intensity relative 
to other blocks. 

7. Fadeable Block: Each block has a detenmnation made 
as to whether it sounds musically viable to fade or not 

In a further aspect of the present invention, a user may 
alternatively prescribe a repeatable audio and/or video 
sequence (or subsequence), e.g., a looping sequence, that is 
capable of repeating and thus has an extended duration. In 
this embodiment, a last block 56 of a compiled sequence 58 
is chosen that is compatible (according to compatibility data 
38) with a first block 60 of the compiled sequence 58. While 
the beginning/ending attribute 36 is of limited significance 
with such a repeatable sequence (and accordingly an ending 
attribute is preferably not required), it is still aesthetically 
preferable that the sequence initially begin with a block 
having a beginning attribute. Additionally, while a principal 
duration 62 of the compiled block sequence (the time 
duration from the beginning of the first block of the repeat- 
able sequence to the end of the last block of the repeatable 
sequence) does not alter the duration of the looping 
sequence (i.e., repeating a twenty second portion thirty-five 
times or repeating a thirty-five second portion twenty times 
both result in the same extended durations), the aesthetic 
effect of such sequences are generally effected by the 
principal duration 62. Accordingly, it is preferable that the 
block sequence compiler 16 accept directions via user 
interface 17 to determine the sequence of blocks according 
to duration 42. 

Accordingly, using the exemplary flow chart of FIG. 6, a 
user specifies duration 42 to specify the principal duration 
62. FIG. 7 shows the processing of the data of FIG. 8 
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according to the flow chart of FIG. 6 for a principal duration 
of thirty-five seconds (compiling sequences ABCDEFGJ 
and ABCDEFHE). Accordingly, it is noted that while the 
end block of the principal loop may have an ending attribute 
36 (e.g., block E), this is not a requirement of the algorithm 5 
of FIG. 6. Additionally, FIG. 7 shows the alternative pro- 
cessing when the algorithm of FIG. 6 is altered to eliminate 
the restriction (specified in program step 64) that requires 
that the compiled sequence begin with a block having a 
beginning attribute 36. Consequently, a sequence of CDEF- 
GHU is compiled. 

In a next variation, e.g., in a visual environment, portions 
of the source audio and/or video segment 28 are determined 
which can play equally well in a forward or in a reverse 
direction. Accordingly, an infinite loop can be defined by 
selecting a sequence of compatible blocks accordingly to 
compatibility list 38 that additionally have a reversible 
attribute 66 set Accordingly, if block sequence compiler 16 
operates on the data of FIG. 10 according to the algorithm 
of FIG. 9 and a prescribed duration 42 of twenty seconds, a 
sequence of CDEF, CDCD, or CDED will result. When 
played, these sequences will preferably reverse in direction 
at the end of the last block and at the beginning of the first 
block (when being played backwards). 

While the above description has primarily discussed uses 
where the entire sequence is repeatable, alternative uses are 
also considered within the scope of the present invention. 
For example, the repeatable sequence could be only a 
portion, i.e., a subsequence, of the compiled output 
sequence. In an exemplary case, a first portion of the output 
sequence is compiled according to first user- specified dura- 
tion (J), a second portion of the output sequence is compiled 
according to a second user prescribed principal duration (K) 
that is repeatable a user-specified number of times (L), and 
a third portion of the output sequence is compiled according 
to a third user-specified duration (M). Consequently, the 
resulting duration will be J+(K*L)+M. 

As described, embodiments of the invention are suitable 
for generating audio and/or video output sequence suitable 
for presentation on a single output channel, e.g., as a single 
audio track, a single MIDI output, a single video clip output, 
a single animation, etc. In an exemplary use, it may be 
required to compile a thirty second video sequence as a 
video output to combine with an existing audio track, e.g., 
assorted pictures of a new car with a predefined description 
of its features, or to add a musical interlude to a predefined 
video clip, and thus create a car commercial. However, it 
may also be desirable to compile both a video sequence and 
an audio sequence to satisfy the user-defined duration cri- 
teria 42, e.g., thirty seconds. However, it will generally be 
significant that the audio and video channels correlate, e.g., 
an audio track describing braking characteristics should not 
be combined with video clips of crash tests. Therefore, FIG. 
11 shows a simplified block diagram of an embodiment that 
enables compiling (using multiple block sequence compilers 
16a-16n or preferably by time sharing a single block 
sequence compiler 16) multiple channels of audio and video 
68a-68n, i.e., multimedia, and cross-correlating the poten- 
tial block sequence lists 19 using cross-correlator 70 to 
ensure compatibility between the multiple channels. To 
achieve this task, the cross-correlator 70 operates upon 
additional compatibility data 38, e.g., data which shows the 
interblock compatibility between the blocks in each channel 
68, i.e., interchannel compatibility. For the example of FIG. 
12, the characteristic table 30 contains additional compat- 
ibility data 38 to ensure that BLOCK l n is compatible with 
both BLOCK 1 L and BLOCK 2 A (since the blocks sizes are 
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not the same on CHANNELi and CHANNEL,,, BLOCK 1„ 
overlaps both BLOCK l x and a portion of BLOCK 2 A ). 

Although the present invention has been described in 
detail with reference only to the presently-preferred 
embodiments, those of ordinary skill in the art will appre- 
ciate that various modifications can be made without depart- 
ing from the invention. Accordingly, the invention is defined 
by the following claims. 

We claim: 

1. A system for compiling data blocks for producing a 
prescribed duration output sequence suitable for driving an 
output transducer, said system comprising: 

a data storage library storing one or more source segments 
wherein each source segment is capable of being par- 
titioned into a plurality of data blocks; 

a stored data table comprised of one or more groups of 
table entries, each such group being associated with a 
different one of said source segments and wherein each 
table entry defines a data block within the associated 
source segment; 

each said table entry additionally identifying characteris- 
tics of the associated data block including its duration, 
its suitability to begin or end an output sequence, and 
its interblock compatibility; 

a user interface for enabling a user to prescribe an output 
sequence duration; and 

a block sequence compiler for iteratively compiling a list 
of one or more output sequences each essentially 
conforming to said prescribed output sequence duration 
and wherein each output sequence is comprised of a 
plurality of data blocks selected according to said table 
entry characteristics. 

2. The system of claim 1 additionally comprising means 
for displaying said list of one or more output sequences. 

3. The system of claim 1 additionally comprising means 
to store at least one said output sequence from said list 

4. The system of claim 1 additionally comprising means 
for driving an output transducer according to an output 
sequence selected from said list. 

5. The system of claim 1 wherein said table entries 
additionally include data identifying a mood parameter for 
each said data block and said user interface additionally 
enables a user to prescribe a mood parameter and said block 
sequence compiler selects data blocks according to said 
user-prescribed mood parameter. 

6. The system of claim 1 wherein said table entries 
additionally include data identifying a fadeable parameter 
for each said data block and said block sequence compiler 
selects an ending data block having said fadeable parameter 
set and wherein such fadeable data blocks can be truncated 
to achieve output sequences of said user-prescribed output 
sequence duration. 

7. The system of claim 1 wherein said table entries 
additionally include data identifying an intensity parameter 
for each said data block and said user interface additionally 
enables a user to prescribe an intensity curve and said block 
sequence compiler selects data blocks according to said 
user-prescribed intensity curve. 

8. The system of claim 1 wherein said table additionally 
comprises data identifying a hit point parameter for each 
said data block for specifying when an intensity burst is 
present within said data block and said user interface addi- 
tionally prescribes an intensity burst location and said block 
sequence compiler compiles output sequences of said data 
blocks according to said user-prescribed intensity burst 
location. 
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9. The system of claim 1 wherein said user interface 
additionally enables a user to prescribe one of said source 
segments and said block sequence compiler compiles output 
sequences of data blocks selected from said user-prescribed 
source segment 5 

10. Hie system of claim 1 wherein said table entries 
additionally include data identifying a static parameter for 
each said data block and said block sequence compiler can 
select an ending data block having said static parameter set 
and wherein such static data blocks can be extended to form 10 
output sequences of said user-prescribed output sequence 
duration. 

11. A method for compiling data blocks for producing a 
prescribed duration output sequence suitable for driving an 
output transducer, said method comprising the steps of: 15 

providing data in a data storage library corresponding to 

at least one source segment; 
partitioning said source segment into a plurality of data 

blocks; 

indicating characteristics corresponding to the duration of 
each data block; 

indicating characteristics of each data block correspond- 
ing to the suitability of each data block to begin or end 
an output sequence and the interblock compatibility of 2 s 
each data block; 

defining a desired duration for an output sequence; and 

iteratively compiling a list of one or more output 
sequences essentially conforming to said prescribed 
output sequence duration and wherein each output 30 
sequence is comprised of a plurality of data blocks 
selected according to said table entry characteristics. 

12. The method of claim 11 additionally comprising the 
step of selecting one of said source segments and wherein 
said iteratively compiling step compiles sequences of data 35 
blocks from those data blocks corresponding to a selected 
source segment 

13. The method of claim 11 additionally comprising the 
step of displaying said compiled list of one or more output 
sequences. 40 

14. The method of claim 11 additionally comprising the 
steps of: 

selecting one of said output sequences from said compiled 
list; and 

45 

outputting a sequence of data blocks corresponding to 
said selected output sequence. 

15. A method for compiling data blocks for producing a 
prescribed duration output sequence suitable for driving an 
output transducer wherein said output sequence is comprised 5Q 
of a plurality of data blocks corresponding to portions of a 
source segment and indicating characteristics of each data 
block corresponding to its duration, its suitability of each 
data block to begin or end an output sequence, and its 
interblock compatibility, said method comprising the steps 
of: 



defining a desired output sequence duration; and 
iteratively compiling a list of one or more output 
sequences each comprised of a plurality of data blocks 
according to said desired output sequence duration such 
that each said output sequence is comprised of a 
plurality of data blocks conforming to its indicated 
characteristics. 

16. A system for compiling data blocks for producing an 
output sequence suitable for repeatable driving an output 
transducer, said system comprising: 

a data storage library for storing one or more source 
segments wherein each source segment is capable of 
being partitioned into a Plurality of data blocks; 

a stored data table comprised of one or more groups of 
table entries, each such group being associated with a 
different one of said source segments and wherein each 
table entry defines a data block within the associated 
source segment; 

each said table entry additionally identifying characteris- 
tics of the associated data block including its duration 
and its interblock compatibility; 

a user interface for enabling a user to prescribe an output 
sequence duration corresponding to the durations of 
said data blocks comprising an output sequence; and 

a block sequence compiler for iteratively compiling a list 
of one or more repeatable output sequences each com- 
prised of a plurality of data blocks selected to essen- 
tially conform to said user-prescribed output sequence 
duration and wherein each output sequence is com- 
prised of a Plurality of data blocks selected according 
to said table entry characteristics. 

17. The system of claim 16 additionally comprising 
means for displaying said list of one or more output 
sequences. 

18. The system of claim 16 wherein each said repeatable 
sequence comprises at least a first data block and a last data 
block and wherein said last data block of each said repeat- 
able output sequence is selected such that the first data block 
of each said repeatable output sequence is compatible, 
according to said table entries, to sequentially follow said 
last data block of each said repeatable output sequence. 

19. The system of claim 16 wherein said table entries 
additionally include a reversible parameter to identify data 
blocks suitable for playing both in a forward or in a reverse 
direction and each said data block selected by said block 
sequence compiler has said reversible parameter set 

20. The system of claim 16 additionally comprising 
means for driving an output transducer according to an 
output sequence selected from said list. 
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157] ABSTRACT 

An audio block sequence compiler for selecting a plurality 
of audio blocks to generate a sequence having a duration 
corresponding to user-prescribed criteria. In a preferred 
embodiment, a user chooses an audio, e.g., a musical, 
segment from a predefined audio library and prescribes the 
duration of an audio sequence. Prior to depositing each 
musical segment in the library, the musical selection is 
divided into audio blocks that are identified in a correspond- 
ing encoding table with characteristics including (1) 
duration, (2) suitability for being used as a beginning or 
ending of an audio sequence, and (3) musical compatibility 
with each audio block Using this characteristic tabic and the 
user-prescribed criteria, i.e., duration, the audio block 
sequence compiler generates a plurality of audio sequences 
satisfying the user-prescribed criteria which can be 
reviewed, e.g.. played, and/or saved for future use. 

21 Claims, 6 Drawing Sheets 
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AUDIO BLOCK SEQUENCE COMPILER In a still further aspect of a preferred embodiment, each 

FOR GENERATING PRESCRIBED block can be identified in the encoding table as having a hit 

DURATION AUDIO SEQUENCES point that defines the location (when present) of an intensity 

burst. When prescribed by the user, the audio block 

COPYRIGHT NOTICE 5 sequence compiler can use the hit point parameter to place 

This patent document contains material which is subject an intensity burst at a user-prescribed location in the gen- 

to copyright protection. The copyright owner has no objec- erated audio sequence. 

tion to the facsimile reproduction by anyone of the patent Other features and advantages of the present invention 

document or the patent disclosure, as it appears in the Patent should become apparent from the following description of 

and Trademark Office patent file or records, but otherwise 10 the presently-preferred embodiments, taken in conjunction 

reserves all copyright rights whatsoever. with the accompanying drawings, which illustrate, by way 

of example, the principles of the present invention. 

BACKGROUND OF THE INVENTION r 

The present invention relates generally to hardware/ BRIEF DESCRIPTION OF THE DRAWINGS 

software systems of the type used to generate audio 15 FIG. 1 comprises a functional block diagram of an audio 

sequences and in particular for generating audio sequences sequence compiler system in accordance with the 

of prescribed durations mat are of particular use for creating present invention for generating audio sequences having 

soundtracks in multimedia systems, e.g., in an audio/video user-prescribed durations; 

environment ^ nG 2 is a simplified diagram of an encoding table 

In an exemplary audio/video environment, a visual showing the parameters associated with each audio block; 

sequence, e.g., a movie/video clip is combined with an FIG. 3A is a simplified flow chart of the operation of the 

audio background. However, visual sequences are often svs tem of FIG 1* 

repetitively edited before an aesthetically satisfactory y „ . , . . 

sequence is achieved. The audio sequence must then be ™1 3D 15 a simplified flow chart depicting the process 

edited to match the duration of the edited video sequence. 25 implemented by the audio block sequence compiler; 

With an available orchestra, this process can be repeated as FIG. 4 is an exemplary encoding table for a fifty second 

often as necessary but it is very expensive. In a more source audio segment; and 

restricted environment, e.g., a multimedia video game, this FIG. 5 shows the iterations performed by the audio block 

procedure is often too costly and cumbersome. ^ sequence compiler according to the flow chart of FIG. 3B on 

~ ~ * * T**r ^ ™ m ^k™^t the data of the encoding table of FIG. 4. 

SUMMARY OF THE INVENTION 6 

The present invention is directed toward an audio block DESCRIPTION OF THE PREFERRED 

sequence compiler for selecting a plurality of suitable, EMBODIMENTS 

compatible audio blocks to generate an audio sequence 35 with reference now to the drawings, and particularly to 

having a duration corresponding to user-prescribed criteria. nc 1, there is shown a block diagram of a preferred 

In a preferred embc<liment a user using a keyboard/ embodiment of an audio sequence generator 10 of the 

mouse interface chooses an audio, e.g., a musical, segment present invention. In a preferred embodiment, the audio 

from a predefined audio library and prescribes the duration sequence generator 10 is comprised of a computer-executed 

of an audio sequence. Prior to depositing each musical ^ software program, generally initially present on a floppy 

segment in the library, the musical selection is divided into disk, and finally residing on the hard disk of a personal 

audio blocks that are identified in a corresponding encoding computer (PC) 12, e.g., a Macintosh or IBM compatible PC, 

table with characteristics including (1) duration, (2) suit- controlled by a processor 13. As such the following 

ability for being used as a beginning or ending of an audio discussion, relates to this preferred PC environment, 

sequence, and (3) musical compatibility with each audio 45 However, different computer platforms or hardware only 

block. Using this characteristic table and user-prescribed implementations are also considered within the scope of the 

criteria, Le., duration, the audio block sequence compiler, presently preferred invention. 

preferably a software program executed by a computer, yh e audio sequence generator 10 is primarily comprised 

generates a plurality of audio sequences satisfying the 0 f i) an audio library 14 and 2) an audio block sequence 

user-prescribed criteria which can be reviewed, e.g., played 50 compiler 16. In operation, a user via a user interface 17, e.g., 

or displayed, and/or saved for future use. a keyboard/mouse 18, chooses a source segment from the 

In a further aspect of a preferred embodiment, the char- audio library 14 and prescribes a duration. This information 

acteristic table additionally contains a mood parameter that is communicated to the audio block sequence compiler 16 

is user prescribed and used by the audio block sequence which, under control of a software program executed by the 

compiler to generate an audio sequence of a selected mood, 55 processor 13 in the PC 12, fetches blocks of audio data from 

In a still further aspect of a preferred embodiment, the the audio library 14 and according to compilation criteria 

encoding table additionally contains a parameter that iden- described further below generates a list of potential audio 

tifies blocks that are fadeable. When a fadeable block is sequences that are preferably temporarily stored within a 

selected as an end block, the audio block sequence compiler potential block sequence list depository 19. At that point, the 

can truncate the fadeable end block to generate an audio 60 user can select to play via a sound card/speaker 20 or review 

sequence of the prescribed length which might otherwise not via a monitor 21 the potential block sequences and/or stare 

be achievable. selected sequences for future use, e.g., on a hard disk 22. 

In a further aspect of a preferred embodiment, the encod- Alternatively, the audio block sequence compiler 16 can 

ing table additionally contains an intensity parameter that, compile a single block sequence until prompted by the 
when selected by the operator, is used by the audio block 65 operator to generate a next audio sequence, 

sequence compiler to generate an audio sequence that most The audio library 14 preferably contains library entries 23 

closely matches a user-prescribed intensity curve. pertaining to a plurality of source audio segments. Each 
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library entry 23 is comprised of 1) a source audio segment 
24 and 2) an encoding table 26 which describes the parti- 
tioning of the source audio segment 24 into blocks and the 
characteristics of each block. Although, the source audio 
segment 24 is shown as being located within the library 14. 5 
one of ordinary skill in the art will recognize that the source 
audio segment 24 can alternatively be physically located 
outside of the library, e.g,, on a CD, and referenced, e.g., by 
pointers, by the encoding table 26. FIG. 2 shows an exem- 
plary structure for the encoding table 26. Each entry 23 in 10 
the encoding table 26 contains a definition/pointer 28 which 
includes identifying information for the library entry, e.g., a 
title and the physical location of the source audio segment 
24, e.g., a CD file. Each encoding table entry 23 is further 
divided into a plurality of entries that define blocks, i.e., 15 
audio blocks, and associated characteristics for the audio 
from the source audio segment 24. In a simplified example, 
a source audio segment 24 is divided into five blocks: A, B, 
C, D, E, F where the sequence ABCDEF corresponds to the 
source audio segment 24, Although, other combinations of 2 o 
blocks, e.g., FEDCBA, also create audio sequences, not all 
sequences of blocks will create aesthetically reasonable 
audio sequences. Thus, it has been determined that infor- 
mation must be derived to determine the musical compat- 
ibility according to aesthetic criteria between each block, 25 
e.g., A, B, and each potential succeeding block, e.g., while 
block C may reasonably follow block B, it may not be 
aesthetically reasonable for it to follow block A. 
Additionally, while some blocks, e.g., A, are suitable accord- 
ing to aesthetic criteria to reasonably start a musical 30 
sequence, other blocks can not. Similarly, only certain 
blocks, e.g., F, are suitable according to aesthetic criteria to 
reasonably end a musical sequence. Lastly, not all source 
audio segments 24 can reasonably be divided into fixed 
length blocks. In fact, using reasonable aesthetic criteria, 35 
blocks will generally be differently sized. Consequently, 
audio sequences of many different durations can be achieved 
by combining different combinations of these differently- 
sized blocks. However, as previously described, the avail- 
able combinations are limited by the compatibility between 40 
potentially adjacent blocks as well as their suitability to 
begin or end an audio sequence. Corresponding to these 
criteria, data in the encoding table 26 for each audio block 
contains parameters pertaining to a 1) a duration 50, 2) a 
type (beginning/end) 32, and 3) a list of compatible blocks 45 
34, i.e., blocks that can aesthetically follow the current 
block. Additionally, information (not shown) identifying the 
physical location of each audio block in the source audio 
segment 24 is retained in the encoding table 26. While data 
in the encoding table 26 can be manually generated, auto- 50 
mated procedures are also possible. 

FIG. 3B shows a simplified flow chart of the iterative 
process implemented by the audio block sequence compiler 
16 after being provided the user-prescribed data (as shown 
in FIG. 3A). As previously described, after the user has 55 
determined a selection 36 from the library 14 and a duration 
38, the audio block sequence compiler 16 operates on the 
data in the encoding table 26 according to the flow chart of 
FIG. 3B. Accordingly, a list of potential audio sequences is 
compiled and stored in the potential block sequence list 19. 60 

FIG. 4 shows an exemplary encoding table for a fifty 
second source audio segment 24. In this example, the source 
audio segment is partitioned into ten blocks, each being five 
seconds long. (However, while fixed length blocks exist in 
mis example, this is often not the case). In this example, 65 
Blocks A and C have been marked as potential beginnings 
and blocks E and J have been marked as potential endings. 
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In the example shown in FIG. 5, the user has selected a 
duration of thirty-five seconds for this source audio segment 
24. Accordingly, FIG. 5 shows the iterations performed by 
the audio block sequence compiler on the encoding table of 
FIG. 4 according to the flow chart of FIG. 3B. FIG. 5 shows 
that the original audio sequence has now been rearranged 
into three potential sequences that each have the prescribed 
duration, begin with a beginning block and end with an 
ending block. 

In an exemplary embodiment, the audio sequence gen- 
erator 10 allows users to quickly and easily create movie or 
record quality music soundtracks for any application or 
document that can import sound The audio sequence gen- 
erator 10 is able to accomplish this by using tie encoded 
music and input from the user. The user selects a musical 
style and sub-style from a list, then specifies the length (in 
minutes, seconds and tenths). A piece of music is selected 
from their library that meets the users needs and a custom 
version of that music is created that is exactly (within 
user-prescribed criteria) the specified length. If the user 
doesn't like the selected music, they can hear a different 
version of the same music or a different piece music — all of 
the versions presented will fit the specifications of the user. 
By using music and its corresponding encoding table 26, 
and input from the user, the compiler 16 can customize the 
following aspects of the music: 
The length of the music can be customized in tenths of 

second increments from seconds to hours. 
Different versions of the same piece of music (sometimes 

hundreds of thousands of options) can be generated. 
In an alternative embodiment, the compiler 16 can cus- 
tomize the intensity of the music. The user can define 
a graph of the intensity which they request on a 
timeline, This will allow them to have the program 
make a piece of music that begins softly (perhaps while 
an announcer speaks) and builds to a climax (perhaps 
when the narration has ended). In this embodiment, an 
intensity parameter is added to the encoding table 26 
for each block and the audio block sequence compiler 
16 selects blocks that most closely correspond to the 
prescribed intensity graph. 
In an alternative embodiment, the user can specify and 
modify the mood of the music without changing any 
other characteristics. In this erribodiment, a mood 
parameter is added to encoding table 14. Additionally, 
multiple renditions of the source audio segment 24 are 
prerecorded corresponding to different moods. The 
audio block sequence compiler 16 will then select 
renditions that correspond to the prescribed mood 
parameter. 

In another alternative embodiment, a user can specify 20 
seconds of background music followed by 12 seconds 
of introductory music. The program will be able to 
locate two different pieces of music and make a 
smooth, musical, transition between them. 

In an additional alternative embodiment, blocks can be 
identified as fadeable blocks in the encoding table 26. 
When a block is fadeable, its duration can be truncated 
to become a satisfactory end block, even if its duration 
would normally be too long. The audio block sequence 
compiler 16 will then truncate the fadeable block to 
achieve the user-prescribed duration. Additionally, the 
intensity of the end of the fadeable block will fade at a 
prescribed rate to reduce the effects of the truncation. 

In still another embodiment, each block can be identified 
in the encoding table 26 as having a hit point that 
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defines the location (when present) of an intensity 
burst. When prescribed by the user, the audio block 
sequence compiler 16 can use the hit point parameter to 
place an intensity burst at a user-prescribed location in 
the generated audio sequence. 
Appendix A is a software listing that describes an exem- 
plary embodiment of the described invention. The following 
defines the data structure for each block of the encoding 
table in this exemplary embodiment: 



to 



filclafo a pointer to which sound file this block is associated with 
blockStart the sample number within the sound file at which this block 
begins 

blocKLength the number of samples that this block contains. Hie end 
sample number is derived by adding blockStart and block- 
Length 

blockName the name to display on this block (no longer than 15 
characters 

blockDesc the long text description of this block (up to 63 characters) 
compatibility an array of bits specifying this block's compatibility with 

all other blocks in this file (described below) 
usageFlags bit flags indicating properties of this block (described 

below) 

ncxtBlock the block number of the best block to following this block 
quickEnd the block number of the best next block to end the music 
quickly 

blockSection a section number of this block assigned for use in grouping 
sub-blocks into grouped blocks for display 

blockPriority a priority number of this block assigned fox use in display- 
ing blocks at different detail levels 

blockType a set of bits specifying if this block should be displayed, if 
the block is in-use, and other status flags. 
USER_BLOCK_TYEE, INV1S IBLE_BL OCK_TYFE, 
AVA1LABLE_JBL OCIC_TYPE 

selected a True/False flag indicating if the block is currently selected 

intensity each block is assigned an intensity index in relation to the 
other blocks in the rile. The higher the intensity number, the 
more intense the audio in the block is in relation to the 
other blocks. 

hitPoint the sample number, if any, of a musical "Hit" within the 

block. (0 for no significant hit) 
moodlndex a number grouping this blocks mood with other blocks 

mood All blocks with the same moodlndex will have the 

same mood, 
next a pointer to the next block 



Compatibility 

Each block has an array of unsigned longs which are used 
as an array of bits. Each bit corresponds to a block from the 
soundfiie. Bit 0 corresponds to block 0, etc. Bit IS should be 
set if the block is compatible with block 15. Compatible 
blocks are blocks which sound musically correct when they 
are played one after the other. For example, "Block A" 
should be flagged as compatible with "Block B" when it 
sound musically correct to listen to "Block A" followed by 
'Block B". If "Block B" was the 24th block from the 
soundfiie, then bit 24 of "Block A"s compatibility array 
should be set. 
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-continued 


USAGEFLAGS 


DEGIN1NG_J3L0CK 
ENDLNG__BLOCK 


Set this bit if the block is a good choice 
(sounds musically correct) to begin a 
selection 

(1L«30) // 0x40000000 

Set this bit if the block is a good choice 

to end a selection 

(1L«31) // 0x80000000 
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While some of the above functions can be applied to 
existing music (through an encoding process) and some are 
dependent on a custom music library in which music is 
composed and performed in a specific format 



struct Blocks truct: { 



20 
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SoundFilelnfoPtr 


nklnfo; // pointer to file struct for mis 




block 


unsigned long 


blockStart// sample number 


unsigned long 


biockLength// number of samples 


StrlS 


blockName; 


Str63 


blockDesc; 


unsigned long 


compatibilitylCOMPAT_SrZEJ; 


unsigned long 


usageFlags; 


short 


nextBlock; 


short 


quickRnd; 


unsigned char 


blockSectiou; 


unsigned char 


blockPriority; 


BlockTypes 


blockiype; 


Boolean 


selected; 


BlockStructPtr 


next; 



30 >; 



USAGEFLAGS 

DEAD_J5ND__FLAG Set if this block will lead you directly 

toward an ending. Set this bit if this 
block is a bad choice to build a long cue 
(1L«0) 

NEXX_CONTIGUOUS_JLAG Set this bit if the next block doesn't 

need a crossfadc to make a good sound- 
ing transition 
(1L«1) 

FADEABLE_BLOCK Set this bit to signal that this block can 

be effectively faded (in volume) to any 
length. 
(1L«2) 



H1KITNG/WARN1NG 

Using the encoded information in the blocks, the user is 
assisted by visually displaying information about the blocks. 
35 Block attributes including beginnings, endings and compat- 
ibility are all displayed. 
Beginning — displayed by a stair-step pattern on the left 

edge of the block 
Ending — displayed by a stair-step pattern on the right 
40 edge of the block 

Compatibility — the rightmost end cap of a selection in the 
sequence window is colored and all of the compatible 
blocks in the block window will have their left end caps 
colored. 

45 Warning — when two non-compatible blocks are next to 
each other, we display a red edge at their junction. 
THE ENCODING PROCESS 

The process of encoding of music and sound is both 
musical and technical. The encoding is used to provide as 

50 much information as possible about each piece of music or 
sound so that the program can make informed, musical 
decisions, when it manipulates the music according to 
requests from users. The encoding process includes the 
following: 

1. Block Start and End: The beginning and ending of each 
discrete music section (block) is determined, Hiis nec- 
essarily determines the length of each block. listen to 
the piece of music and divide it into segments based on 
musical phrases and musical uses called blocks. On 

^ average there are fifteen blocks per minute of music. 

2. Block Name: Code each block with a name and 
description. 

3. Beginning Blocks: For each block a determination is 
made as to whether it would make a good way to start 

65 a musical section or phrase. 

4*. Ending Blocks: Same concept as that described for 
Beginning Blocks, 
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5. Block Compatibility; Each block is tested for its 
specific compatibility to each and every other block 
which comprise the source audio segment. 

6. Intensity: Code each block's musical intensity relative 
to other blocks. 

1. Fadeable Block: Each block has a determination made 
as to whether it sounds musically viable to fade or not 

Although the present invention has been described in 
detail with reference only to the presently -preferred 
embodiments, those of ordinary skill in the art will appre- 
ciate that various modifications can be made without depart- 
ing from the invention. Accordingly, the invention is defined 
by the following claims. 

We claim: 

1. A system for generating an audio sequence having a 
prescribed duration, comprising: 

a table referencing one or more predefined audio seg- 
ments wherein said table contains entries to partition 
each of said predefined audio segments into blocks; 

said table entries including data corresponding to the 
duration of each said block, the suitability for each said 
block to begin or end an audio sequence, and the 
compatibility of each said block to sequentially follow 
each other said block; 

a user interface for permitting a user to prescribe an audio 
sequence duration; 

an audio block sequence compiler for iteratively compil- 
ing a list of one or more audio sequences each com- 
prised of a plurality of blocks selected according to said 
user-prescribed audio sequence duration such that each 
said audio sequence conforms with said table entries; 
and 

means for displaying said list. 

2. The system of claim 1, additionally comprising means 
to store at least one said audio sequence from said list. 

3. The system of claim 1, additionally comprising means 
to play a selected audio sequence from said list. 

4. The system of claim 1, wherein said table additionally 
comprises data corresponding to a mood parameter for each 
said block and said user interface additionally prescribes a 
mood parameter and said audio block sequence compiler 
selects blocks according to said user-prescribed mood 
parameter. 

5. The system of claim 1, wherein said table additionally 
comprises data corresponding to a fadeable parameter for 
each said block and said audio block sequence compiler can 
select a fadeable block as an ending block and wherein said 
fadeable blocks can be truncated to achieve audio sequences 
of said user-prescribed audio sequence duration. 

6. The system of claim 1, wherein said table additionally 
comprises data corresponding to an intensity parameter for 
each said block and said user interface additionally pre- 
scribes an intensity curve and said audio block sequence 
compiler selects blocks according to said user-prescribed 
intensity curve. 

7. The system of claim 1, wherein said table additionally 
comprises data corresponding to a hit point parameter for 
each said block for specifying when an intensity burst is 
present within said block and said user interface additionally 
^escribes an intensity burst location and said audio block 
sequence compiler selects the sequence of said blocks 
according to said user-prescribed intensity burst location. 

8. A system for generating an audio sequence having a 
prescribed duration, comprising: 

a storage device for storing a table referencing one or 
more predefined audio segments wherein said table 
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contains entries to partition each of said predefined 

audio segments into blocks; 
said table entries including data corresponding to the 

duration of each said block, the suitability for each said 
5 block to begin or end an audio sequence, and the 

compatibility of each said block to sequentially follow 

each other said block; 
a user input device for permitting a user to prescribe an 

audio sequence duration; 
10 a processor for iteratively compiling a list of one or more 

audio sequences each comprised of a plurality of blocks 

selected according to said user-prescribed audio 

sequence duration such that each said audio sequence 

conforms with said table entries; 
15 a monitor for displaying said list; 

an audio apparatus for playing a selected audio sequence 

from said list. 

9. The system of claim 8, additionally comprising means 
to store at least one said audio sequence from said list 
20 10. The system of claim 8, additionally comprising means 
to play a selected audio sequence from said list using said 
audio apparatus. 

11. The system of claim 8, wherein said table additionally 
comprises data corresponding to a mood parameter for each 

25 said block and said user interface additionally prescribes a 
mood parameter and said conipiling means can select blocks 
according to said user-prescribed mood parameter. 

12. The system of claim 8, wherein said table additionally 
comprises data corresrxmding to a fadeable parameter for 

30 each said block and said compiling means can select a 
fadeable block as an ending block and wherein said fadeable 
blocks can be truncated to achieve audio sequences of said 
user-prescribed audio sequence duration, 

13. The system of daim 8, wherein said table additionally 
35 comprises data corresponding to an intensity parameter for 

each said block and said user interface additionally pre- 
scribes an intensity curve and said compiling means selects 
blocks according to said user-prescribed intensity curve, 

14. The system of claim 8, wherein said table additionally 
^ comprises data corresponding to a hit point parameter for 

each said block for specifying when an intensity burst is 
present within said block and said user interface additionally 
prescribes an intensity burst location and said compiling 
means selects the sequence of said blocks according to said 
45 user-prescribed intensity burst location. 

15. The system of claim 8 wherein said user input device 
additionally permits a user to prescribe an audio segment 
and said audio block sequence compiler compiles sequences 
each comprised of a plurality of blocks selected from said 

5Q user prescribed audio segment. 

16. The system of claim 1 wherein said user interface 
additionally permits a user to prescribe an audio segment 
and said processor compiles sequences each comprised of a 
plurality of blocks selected from said user prescribed audio 

55 segment. 

17. A method for generating an audio sequence of a 
prescribed duration, comprising the steps of: 

providing at least one prerecorded audio segment; 
defining discrete blocks in said audio segment and indi- 
go eating characteristics corresponding to the duration of 
each block; 

assigning to each block characteristics corresponding to 
the suitability of each block to begin or end an audio 
sequence and the compatibility of each said block to be 
65 sequentially followed by each other block; 

defining a desired duration for an output audio sequence; 
and 
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iteratively compiling a list of one or more audio 
sequences each comprised of a plurality of blocks 
according to said desired duration such that each said 
audio sequence conforms with said characteristics of 
each block. 

18. The method of claim 17 additionally comprising the 
step of selecting an audio segment and wherein said itera- 
tively compiling step compiles sequences of blocks from 
those blocks corresponding to said selected audio segment 

19. The method of claim 17 additionally comprising the 
step of displaying said compiled list. 

20. The method of claim 17 additionally comprising the 
steps of: 

selecting an audio sequence from said compiled list; and 
playing said selected audio sequence. 

21. A method for generating an audio sequence of a 
prescribed duration from an audio segment having pre- 
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defined discrete blocks indicating characteristics corre- 
sponding to the duration of each block and preassigned 
characteristics corresponding to the suitability of each block 
to begin or end an audio sequence and the compatibility of 
5 each said block to be sequentially followed by each other 
block* comprising the steps of: 

defining a desired duration for an output audio sequence; 
and 

10 iteratively compiling a list of one or mare audio 
sequences each comprised of a plurality of blocks 
according to said desired duration such that each said 
audio sequence conforms with said characteristics of 

15 each block. 

***** 



